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Expert  Opinion  in  Reliability 


ABSTRACT 

In  this  report  we  present  some  results  on  the  formal  treatment  of  expert  opinion  in  reliability 
analysis.  We  discuss  a  procedure  which  uses  opinion  of  one  or  two  experts  for  undertaking  the 
reliability  assessment  of  a  component.  Then  we  develop  the  methodology  for  point  processes  broadly 
used  in  the  analysis  of  defect  and  count  data. 


Keywords:  Weibull  Distribution,  Nonhomogeneous  Poisson  Process,  Expert  Opinion,  Life  Data,  Defect 
and  Failure  Counts  Data. 


1.  INTRODUCTION 


The  use  of  expert  opinion  or  informed  judgment  has  become  prevalent  in  practical  applications  of 
reliability  and  risk  analysis.  This  issue  is  motivated  by  the  fact  that  modern-day  components  and 
systems  are  designed  for  high  reliability  and  so  the  availability  of  even  a  small  amount  of  failure  data 

is  difficult. 

In  this  paper,  we  present  some  results  on  the  formal  treatment  of  expert  opinion  in  reliability 
analysis.  The  overall  methodology  is  based  on  a  theme  described  by  Lindley  (1983).  In  Section  2,  we 
introduce  a  procedure  which  uses  opinion  of  one  or  two  experts  for  undertaking  the  reliability 
assessment  of  a  component.  In  Section  3,  we  discuss  the  methodology  for  point  processes  broadly  used 
in  the  analysis  of  defect  and  failure  counts.  In  Section  4,  we  present  an  illustrative  real  world 
application.  In  Section  5,  we  conclude  with  some  final  comments. 


2.  ELICITATION  AND  MODULATION  OF  EXPERT  OPINION  FOR  COMPONENT  RELIABILITY 
ANALYSIS  USING  THE  WEIBULL  DISTRIBUTION 

Consider  the  unknown  quantity  X  =  the  life  length  of  a  unit.  Let  a  Weibull  distribution  with 
scale  parameter  a  and  shape  parameter  0  be  a  meaningful  probability  model  for  X.  Then,  the 
reliability  of  the  unit,  given  a  and  0,  is 

R(x  |  a,0)  =  Pr{X  >  x  |  or, 0}  =  exp  (-  (5)^). 

Given  that  a  and  0  are  also  unknown  quantities,  the  reliability  function  of  the  unit  for  a  given  mission 
time  x  is  also  a  random  variable.  The  goal  in  reliability  analysis  is  to  make  statements  of  uncertainty 
about  both  X  and  R(x  |  a,0)  conditional  on  the  available  information.  Note  that  in  our  notation  the 
same  letter  may  express  either  the  random  variable  or  a  particular  realization  of  such  a  random 
variable.  Whenever  we  want  to  emphasize  on  a  random  variable  we  use  the  letter  in  bold.  Also,  note 
that  we  use  the  terms  unknown  quantity  and  random  variable  indistinctly. 

The  Bayesian  scheme  requires  the  specification  of  a  prior  joint  distribution  on  a  and  0,  which  we 
denote  ir(a,0).  Suppose  that  7 r(a,/3)  is  given,  then,  the  reliability  of  the  unit  is  assessed  as 

R(x)  =  Pr{X>x}=  |  R(x  |  a,/?)  tt(q,/?)  da  d/?.  (1) 

a,/? 
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Furthermore,  for  a  fixed  mission  time  x,  a  statement  of  uncertainty  about  R(x  |  a,P)  can  be  provided 
by  means  of  the  following  expression 


Pr{R(x|a,/?)<c} 


|  7r(a,/?)  da  d 3. 

{(a,/?):R(x|a,/?)<c} 


(2) 


Once  failure/survival  data  become  available,  the  prior  distribution  on  (or,/?)  is  updated  through  Bayes 
law.  Then,  7r(a,/J)  in  Equations  (1)  and  (2)  is  replaced  by  the  resulting  posterior  distribution  in  order 
to  revise  the  uncertainty  about  both  X  and  R(x  |  ot,P)- 

We  present  a  procedure  for  the  construction  of  the  prior  distribution  with  the  use  of  expert 
opinion.  The  procedure  allows  the  participation  of  one  or  two  experts  as  suppliers  of  expert  opinion. 
An  analyst,  who  is  in  general  the  decision  maker,  monitors  the  participation  of  each  expert.  In  the  case 
of  two  experts,  the  analyst  has  to  express  his  (her)  opinion  about  the  relationship  between  the  two 
experts  by  specifying  p,  the  correlation  between  the  experts.  For  the  Weibull  distribution,  it  is  easier 
to  elicit  expert  opinion  on  the  shape  parameter  p  (characterizing  aging),  than  on  the  scale  parameter  a. 
Therefore,  we  introduce  the  median  life  M,  M=a(ln2)1/^,  and  elicit  expert  opinion  on  M  and  p. 
Section  2.1  pertains  to  the  elicitation  of  expert  opinion  on  the  median  life  M.  Section  2.2  pertains  to 
the  elicitation  of  expert  opinion  on  the  shape  parameter  p.  Section  2.3  pertains  to  the  assessment  of 
the  joint  distribution  on  (a,P)  and  its  revision  in  the  light  of  observed  failure  and/or  survival  data. 
Whether  we  have  the  prior  or  posterior  distribution  on  (a,0),  Equations  (1)  and  (2)  have  to  be 
assessed.  Advanced  numerical  techniques  can  be  used  to  efficiently  evaluate  the  integrals,  f  or  details 
on  an  implementation  of  the  proposed  procedure,  refer  to  Aboura  and  Campodomco  (1992). 

Finally,  let  us  point  out  that  a  series  of  assumptions  have  been  made  in  order  to  construct  the 
prior  distribution,  yet  other  assumptions  are  of  course  possible.  For  example,  Singpurwalla  and  Song 
(1988)  introduced  an  approach  for  elicitation  of  expert  opinion  on  the  median  life  using  a  chi-square 
distribution,  in  which  case  the  reliability  assessments  were  evaluated  using  approximations  from 
Tierney  and  Kadane  (1986). 

2.1  Elicitation  of  expert  opinion  on  the  median  life  M  using  a  Gaussian  distribution 

Two  experts  are  asked  about  their  opinion  on  the  median  life  M  of  the  component.  Suppose  that 
expert  i  conceptualizes  his  (her)  uncertainty  about  M  via  some  distribution  with  mean  m,  and  standard 
deviation  s,,  i  =  1,  2. 
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The  analyst  views  the  m,’s  and  the  s-’s  as  realizations  of  random  variables  and  makes  some 
assumptions  in  order  to  construct  a  distribution  on  M  given  the  experts  input  \alues.  Let  cc 
denote  “proportional  to,1'  then  the  density  of  interest  is 

p(M  |  m1,m2,s1,s2)  oc  p(m1,m2,s1,s2  |  M)  p(M)  =  p(m1,m2  |  s^Sj.M)  p(s1,s2  |  M)  p(M). 


The  analyst  assumptions  are 
Assumption  1:  p(M)  is  effectively  constant, 

Assumption  2:  p(sj,  s2  |  M)  does  not  depend  on  M, 

Assumption  3:  p(mt,m2  |  Sl,s2,M)  is  a  bivariate  normal  distribution  with  E(m,-)  =  b ,M  +  a,-, 
Var(m1)  =  (7-  s-)2,  i  —  1,2,  and  correlation  p  between  mt  and  m2. 

The  parameters  a,-,  b,  and  7,  reflect  the  analyst  judgment  of  the  expertise  of  expert  :,  i  =  1,2,  and  p  is 
the  correlation  between  the  two  experts  in  the  analyst  opinion.  For  example,  if  the  analyst  considers 
that  expert  i  is  unbiased  in  the  specification  of  m,,  then  a,  =  0  and  b,  =  1;  if  b-  =  1,  then  a-  is  a  bias 
term  that  expresses  the  analyst  view  that  expert  i  overestimates  (underestimates)  M  by  an  amount  a,; 
if  the  analyst  thinks  that  expert  i  overestimates  (underestimates)  M  by  some  percentage,  say  10%,  then 
a.  -  0,  b-  =  1.1  (0.9);  finally,  if  the  analyst  thinks  that  expert  i  exaggerates  (is  cautious  about)  the 
standard  deviation  s-,  then  7,  >  (  <  )  1- 

Under  the  above  three  assumptions,  p(M  |  m1,m2,s1,s2)  oc  p(mj,m2  |  s^^jjM)  from  which  the 
following  results  [see  Lindley  (1983)]:  The  uncertainty  about  M  is  described  via  a  normal  distribution 
with  mean 

E  b,  <7,J  (m j  —  a.-)  /  b.^bj, 

i,J= 1  /  '’J=1 

and  standard  deviation 

/  \  —1  /  2 

where  a'3  are  elements  of  the  matrix  that  is  the  inverse  of  that  with  elements  cr,-,  =  (7,  s ,)  ,  1  =  1,  2, 
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and  <r12  =  p(crn<722)1//2  =  <t21.  Since  M  is  nonnegative,  we  consider  the  truncated  density  of  M  as 


K 


7r(.Vl  \n,a)  =  -[===  exp 


tp  (-0.5  (: 


V)  Jl  M>0. 


/  oc  \ 

I  r  .  /„  2  ' 


rhere 


K  = 


( 2 7T )  ly/2  exp(—  ^-)  du 


\-n/a 


2.2  Elicitation  of  expert  opinion  on  the  shape  parameter  /? 

The  procedure  assumes  that  expert  i.  i  =  1,2,  conceptualizes  the  uncertainty  about  /?,  the  shape 
parameter  of  the  Weibull  distribution,  via  a  lognormal  distribution  with  density 


rr(  J  |  AllPl) 


M‘2jt  p,  j3 


exp 


-^(lnd-A,)2 

2P, 


The  parameters  A,  and  p,  are  called  the  "log  mean"  and  the  "log  standard  deviation”,  respectively. 
The  mean  and  the  standard  deviation  of  the  lognormal  distribution  are 


W/2  and  ^e2A*+P*UP--lJ, 


respectively.  The  values  of  A,  and  p,  are  pinned  down  by  questioning  expert  i  about  the  rate  of 
deterioration  of  the  component.  Having  assigned  values  to  A,  and  p-,  i  =  1,  2,  and  under  assumptions 
similar  to  Assumptions  1  to  3  in  section  2.1,  the  analyst  describes  the  uncertainty  about  /?  via  a 
lognormal  distribution  with  log  mean  parameter 

S  =  £  £’J  A,  /  E 

i,J- 1  /  <>2=1 


and  log  standard  deviation  parameter 


a 


/ 


where  are  elements  of  the  matrix  that  is  the  inverse  of  that  with  elements  -  pf,  i  —  1,  2,  and 
£l2  =  ^21  =  11^22)  ^  • 
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In  other  words,  the  analyst  ends  up  with  the  following  prior  distribution  on  /? 


\  v'y)  =  .[kz  exp 


*sj^7r  a'  3  \  2a 


2.3  Prior  and  posterior  joint  distribution  on  (a,0) 

Since  M  =  a( \n(2))1^,  then  the  prior  density  of  a  is  given  by 


H!p^exp(  a  >  0; 


*(*\0,W)=  ^  —  exP\-2 


and  the  prior  joint  density  of  a  and  0  is 


7T(q ,0  I  =  jr(a  |  0,h,<t)  ir{0  I  /V) 


K(ln2) 


1 13 


■^2tt 


-  exp  l  —k 


Once  life  data  are  obtained,  say  D  =  (x,,...,  xn,  st .  sm)  where  the  x,(s,-)’s  are  failure  (survival) 

data,  the  likelihood  of  or  and  0  is  obtained  as 

n(i)(sr‘»p(-(sf)  ft  4-Gf) 

i=i  j=i 

i.e.,  the  likelihood  is  the  joint  density  of  the  observed  values  when  regarded  as  a  function  of  the 
parameters.  Then,  the  posterior  joint  density  of  (a,0)  can  be  evaluated  through  Bayes  law, 

7T(tt,0  |  p,/i,<r,/iV)  OC  l{a,0  I  Q)  TT{a,0  \  ,/iV). 


3.  ELICITATION  AND  MODULATION  OF  EXPERT  OPINION  FOR  A  POINT  PROCESS 

Consider  now  the  stochastic  process  (N(t),  t  >  0}  where  N(t)  represents  the  total  counts  which 
occur  up  to  time  t.  A  counting  process  finds  multiple  applications  in  modeling  the  number  of  defects 
or  failures  in  a  system.  Suppose  that  {N(t>,  t  >  0}  is  modeled  as  a  non-homogeneous  Poisson  process 
(NHPP)  with  intensity  function  r(t  |  0)  and  mean  value  function  M(t  |  0)  =  E(N(t)  |  0),  where  0  is  a 
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vector  of  model  parameters.  In  a  NHPP  the  mean  value  function  and  the  intensity  function  are  related 
as  follows. 

t 

M(t  |  0)  =  J  r(s  |  6)  ds. 

o 

Conversely,  the  intensity  function  represents  the  instantaneous  rate  of  change  of  the  expected  number 
of  counts,  i.e., 

^M(t  |  0)  =  r(t  |  0). 


Therefore,  if  r(t  |  0)  is  an  increasing  function  on  t,  then  counts  are  expected  to  be  more  frequent  as 
time  increases.  If  r(t  |  0)  is  a  decreasing  function  on  t,  then  counts  are  expected  to  be  more  scarce  as 

time  evolves. 

Suppose  that  the  uncertainty  on  0  is  represented  by  the  joint  distribution  7r(0),  then  the  aim  of  a 
NHPP  analysis  is  to  estimate  quantities  of  interest  such  as 


•  The  expected  number  of  counts  in  the  interval  (0,t]  : 


E(N(t))  =  M(t)  = 


M(t  I  0)  7T(0)  d0. 


0 


•  The  expected  number  of  counts  in  the  interval  (s,t],  s  <  t  : 

E(N(s,t))  =  (M(t  |  0)  -  M(s  |  ©))  tt(0)  d0. 
0 

•  The  probability  of  k  counts  in  the  interval  (0,t],  k  =  0,  1,  2,...  : 

-M(t  |  0)  [M(t  |  0)]k 


Pr{N(t)  =  k}  = 


k! 


7T(0)  d0. 


0 


•  The  probability  of  k  counts  in  the  interval  (s,t],  s  <  t,  k  —  0,  1,  2,. . .  : 


(3) 


(4) 


(5) 


Pr{N(s,t)  =  k}  = 


~  (M(l  I  0)  _  M(s  I  [M(t  |  0)  -  M(s  1  0)]k 


k! 


7r(0)  d0. 


0 


(6) 
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Our  goal  now  is  to  continue  with  the  general  scheme  presented  in  the  previous  sections  and  use 
expert  opinion  in  the  construction  of  a  prior  distribution  on  the  model  parameters  (or  a  transformation 
of  the  parameters).  In  the  following  we  consider  two  well-used  processes  and  develop  a  series  of 
assumptions  for  the  elicitation  and  modulation  of  expert  opinion  for  their  analyses.  We  consider  one 
expert  only,  and  as  before,  expert  opinion  is  monitored  by  an  analyst. 

The  first  process  under  consideration  is  the  power-law  process,  also  known  as  the  Weibull  process 
because  of  the  facts  that  its  intensity  function  behaves  like  the  failure  rate  function  of  a  Weibull 
distribution  and  the  occurrence  time  of  the  first  count  is  W'eibull  distributed.  The  Weibull  process  is 
quite  flexible  in  the  sense  that  its  intensity  function  can  be  either  increasing,  constant  or  decreasing. 
The  second  process  considered  here  is  known  as  the  Logarithmic  Poisson  model  which  has  become  one 
of  the  more  popular  models  in  software  reliability.  The  intensity  function  for  the  Logarithmic  Poisson 
process  is  always  a  decreasing  function  and  its  derivation  encapsulates  the  belief  that  the  intensity 
function  decreases  exponentially  with  the  number  of  failures  experienced  [see  Musa  and  Okumoto 
(1984)].  Section  3.1  pertains  to  the  elicitation  and  modulation  of  expert  opinion  in  the  Weibull 
process.  Section  3.2  accommodates  the  same  approach  to  the  Logarithmic  Poisson  process. 

3. 1  Elicitation  and  modulation  of  expert  opinion  for  the  Weibull  process 

The  intensity  function  and  the  mean  value  function  of  the  Weibull  process  are 

r(t  |  «,/?)  =  g  (&f  ~  1  and  M(t  |  a,0)  =  (i)  ,  t  >  0, 

respectively,  where  a  is  the  scale  parameter  and  P  is  the  shape  parameter.  The  model  is 
reparametrized  by  introducing  two  unknown  quantities  for  which  the  expert  visualizes  a  prior 
distribution  more  naturally.  Consider  two  index  points  Tj  and  T2,  such  that  Tx  <  T2,  and  define  the 
unknown  quantities  and  M2  as 

Mi  =  (T x/af  and  M2  =  (T2/af.  (7) 

That  is,  M,-  represents  the  expected  number  of  counts  in  the  interval  [0,  T,),  for  i  =  1,  2.  Given  Tj 
and  T2,  Equation  (7)  provides  a  relationship  between  (M^Mj)  and  (a,P)  from  which  a  and  p  can  be 
explicitly  determined  in  terms  of  Mj  and  M2.  Let  a  =  «(MrM2)  and  p  =  /?(MrM2),  where  <*(',•) 
and  /?(•,•)  are  the  corresponding  transformation  functions.  Now,  the  model  can  be  written  in  terms 


7 


of  (Mj,M2).  For  example,  the  mean  value  function  of  the  process  conditioned  on  Mj  and  M2,  denoted 
by  M(t  |  •  ),  takes  the  following  equivalent  form 

v/?(Mx,M2) 

M(t|-)sM(t|M1,MJ)=^spai^j 

A  prior  distribution  on  (M,,M2),  say  tr(M,,M2),  is  obtained  from  the  interaction  of  an  expert  and 

s. 

an  analyst.  For  each  Mf,  the  expert  8  visualizes  a  distribution,  say  p^j.(  ■ ),  i  =  1,  2,  and  declares  to 

*  s 

the  analyst  A  two  numbers  m,  and  s,  as  measures  of  the  location  and  the  scale  of  pM^(  • ),  respectively. 
The  analyst  A  views  the  m,’s  and  the  Sj’s  as  realizations  of  two  random  variables  A>  •  and  If,-,  i  =  1,  2, 
and  models  the  distributions  of  and  based  on  both  his  (her)  opinion  (U’s  opinion)  of  the 
expertise  of  8  and  his  (her)  perceived  correlation  between  and  and  and  ?2.  Table  1 

summarizes  our  notation. 


Table  JL  Summary  of  the  Notation 


Nature 

Mean 

St. Deviation 

Mr 

Random 

quantity 

A 

*1 

counts  in 

(0,TJ 

Expert’s 
declared  value 

mi 

S1 

m2 

Random 

quantity 

*2 

counts  in 

(o,t2] 

Expert’s 
declared  value 

m2 

s2 

The  goal  is  to  use  the  m,’s  and  the  s,-’s,  i  =  1,  2,  and  A' s  view  of  the  expertise  of  the  expert  to 
arrive  at  a  joint  distribution  for  Mj  and  M2. 

Since  8  assesses  both  and  M2  and  since  Mj  <  M2,  it  is  reasonable  to  suppose  that  and  Jk2 
will  be  dependent  and  positively  so.  That  is,  large  values  of  will  lead  to  large  values  of  Jk2  and 
vice  versa.  Also,  the  declared  values  nij  and  m2  are  such  that  mj  <  m2. 

Given  m^  m2,  Sl  and  s2,  we  need  to  obtain  p(MltM2  |  ml,m2,s1,s2).  By  Bayes  law, 
p(Mj,M2  I  m1,m2,s1,s2)  oc  p{m1,m2,s1,s2  |  MltM2)  pCMj.Mj). 
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The  first  term  on  the  right  hand  side  is  the  likelihood  and  can  be  factored  as 


p(m1,m2,s1,s2  |  MX,M2)  = 


Pjtt2(m2  I  mi,s1,s2,M1,M2)  pyj s2 


mx,Sj,Mj,M2)  P^(mj 


s1,M1,M2)  p^(sx  |  Mj,M2). 


The  subscripts  associated  with  each  p  pertain  to  the  random  variable  upon  whose  distribution  A’s 
likelihood  is  based.  To  evaluate  the  above  likelihood,  A  makes  a  series  of  assumptions.  A  justification 
for  assumptions  of  this  type  has  been  given  by  Lindley  (1983).  The  assumptions  are: 


Al.  is  independent  of  Mx  given  M2,  'S x  and  f2; 

thus  pj^  (m2  |  m1,s1,s2,M1,M2)  =  Pjt2^m 2  I  miisi>s2’^2)- 

A2.  pj^  (m2  |  m1,s1,s2,M2)  is  a  truncated  normal  with  a  mean  a  +  bM2  and  standard  deviation  7s2;  the 
truncation  is  on  the  left  and  the  point  of  truncation  is  mx  +  ksx,  where  k  is  specified  by  A.  The 
constants  a,  b  and  7  reflect  .A’s  views  on  the  expertise  of  S.  For  an  interpretation  of  a,  b  and  7, 
see  Lindley  (1983). 


A3.  f2  is  independent  of  Jtx  given  :fx,  Mx  and  M2;  thus  p^  ( s2  |  m1,s1,M1,M2)  -  p(s2  |  Sj.Mj.M2). 


A4.  pj,  (s2  |sj,Mj,M2)  is  a  truncated  normal  with  mean  sx  and  variance  (M2  -  Mx);  the  truncation  is 


on  the  left  and  the  point  of  truncation  is  0. 


A5.  Jtj  is  independent  of  M2  given  Mx  and  'Sl\  thus  p^(mj  |  Sj,Mj,M2)  -  Pjtj(ml  I  sl>Ml)- 

j\ p  |sj,Mj)  is  a  truncated  normal  with  mean  a  +  bMj  and  standard  deviation  7Sj.  The  point 

of  truncation  is  on  the  left  and  is  at  0.  The  parameters  a,  b  and  7  are  the  same  as  in  A 2. 


A7.  py  (sx  |  Mj,M2)  is  exponential  with  mean  (M2  -  Mx).  This  implies  that  as  the  disparity  between 
Mx  and  M2  increases,  the  uncertainty  :fx  becomes  larger  and  larger. 

A8.  p(Mx,M2)  is  relatively  constant  over  the  range  of  Mx  and  M2  on  which  the  likelihood  is 
appreciable. 
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Theorem  L 


Under  Assumptions  A1-A8,  the  joint  distribution  of  and  M2,  given  m,,  m2,  sv  s2  and  A's 
assessment  of  the  expertise  of  §  (denoted  by  $)  is  given  by 


p(M1,M2  I  m1,m2,s1,s2,$)  oc 


expj 

(  ,  ( m2-a-bM2 
{  2\  Ts2 

(i-«l 

^m^ksj— a— bM2 

v  7s2 

M2-M! 


where  0  <  Mj  <  M2  <  <00,  and  $(u)  — 


f  exp(— x2/2) 


dx. 


Suppose  now  that  the  number  of  counts  in  a  total  of  N  disjoint  intervals  are  observed.  Let 
rjj  =  observed  number  of  counts  in  the  interval  (tl2,t2j],  i  =  !»•••>  bet 

D  =  {r]j,  tlj(  1 2j  ■  i  —  !>•••)  N) 

denote  the  data  set.  We  update  the  distribution  on  (Mj,M2)  by  means  of  Bayes  law  which  establishes 
that 


7t(M1,M2  I  D)  oc  JL(Mj,M2  I  D)  (8) 

The  likelihood  function  L(M1,M2  |  D),  the  joint  density  of  the  observed  values  when  regarded  as  a 
function  of  the  parameters,  is  given  by 

A  e  ( M(t2j  I  *  )  "  M(t*>  1  ' })  (M(t2j  |  • )  -  1  •  jf’ 

Jt(MlfM2 1  d)  =  n - -n 

j-i  3 

The  constant  of  proportionality  for  Equation  (8)  is  such  that  k(MvU2  I  D)  obeys  the  rules  of 
probability,  i.e.,  it  integrates  to  one  over  the  range  of  (MltM2). 
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3.2  Elicitation  and  modulation  of  expert  opinion  for  the  Logarithmic  Poisson  process 

An  equivalent  procedure  can  be  developed  for  the  Logarithmic  Poisson  process  whose  intensity 
function  and  mean  value  function  are  given  by 

r(t  1 0,\)  =  xyf+T  and  M(t  1  M)  =  I ln(A  6 1  + 1}’ 1  -  °’ 

respectively,  where  0,  X  >  0  are  the  model  parameters,  two  unknown  quantities.  We  reparametrize  the 
model  as  in  section  3.1.  Given  T,  and  T2  such  that  Tx  <  T2,  we  define  the  unknown  quantity 
M,  =  M(T,  |  0,A)  =  ^  ln(A  0  T,  +  1),  i  =  1,  2.  The  system  of  equations 

f Mj  =  ln(A  0  Tt  +  l)/0 
|m2  =  ln(A  5T2+  l)/0 

has  a  solution  on  (tf,A),  ®  >  0,  if  and  only  if  Mj  <  M2  <  This  fact  should  be  taken  into  account 

when  eliciting  a  joint  distribution  on  (M^,M2). 

As  before,  g  visualizes  a  distribution  for  each  M,-,  say  pg^i(  • ),  1=1,  2,  and  declares  to  the 
analyst  A  two  numbers  m,  and  s<  as  measures  of  the  location  and  the  scale  of  PgM*(  • ),  respectively. 
The  declared  values  mj  and  m2  are  such  that  mt  <  m2  <  (T2/Tj)  m2. 

The  analyst  A  views  the  m,’s  and  the  s,’s  as  realizations  of  two  random  variables  Jt,-  and 
i  _  i,  2,  and  models  the  distributions  of  and  based  on  both  his  (her)  opinion  of  the  expertise  of 
g  and  his  (her)  perceived  correlation  between  and  Jk>2  and  and  f2. 

We  consider  the  same  assumptions  as  in  section  3.1  with  a  slight  modification  in  Assumption  A2 
in  order  to  satisfy  the  requirement  that  M1  <  M2  <  (Tj/Tj)  Mr  Let  us  rewrite  the  corresponding 
Assumption  A2/. 

A2'.  pj ^  (m2  |  m1,s1,s2,M2)  is  a  truncated  normal  with  a  mean  a  +  bM2  and  standard  deviation  ys2; 
the2  truncation  is  on  the  left  and  right.  The  left  point  of  truncation  is  m2  +  ksl5  where  k  is 
specified  by  A.  The  right  point  of  truncation  is  (T2/Tj)  mr  The  constants  a,  b  and  7  reflect 
A's  views  on  the  expertise  of  the  expert.  For  an  interpretation  of  a,  b  and  7,  see  Lindley  (1983). 
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Theorem  2.  Under  Assumptions  A1-A8  (from  Section  3.1),  with  A2  replaced  by  A2',  the  joint 
distribution  of  Mx  and  M2,  given  mlt  m2,  sv  s2  and  A’s  assessment  of  the  expertise  of  8  (denoted  by 
$)  is  given  by 


p(MltM2  |  m1,m2,s1,s2,$)  oc 


This  expression  provides  the  prior  joint  density  distribution  on  Mj  and  M2.  As  in  Section  3.1, 
this  distribution  can  be  updated  in  the  light  of  observed  data. 

4.  APPLICATION 

In  this  Section,  we  present  an  illustrative  scenario  from  the  railroad  industry  using  a  Weibull 
process  (Section  3.1). 

A  railroad  track  ages  and  develops  fatigue  defects  up  to  a  point  where  they  become  excessive  and 
the  track,  or  part  of  it,  has  to  be  replaced.  The  optimal  schedule  for  the  replacement  of  the  track 
depends  on,  among  other  variables,  the  number  of  fatigue  defects  predicted  for  a  future  time.  A 
Weibull  process,  indexed  over  load  traffic  (in  million  gross  tons),  is  used  to  model  the  number  of 
fatigue  defects  on  the  track  segment.  In  order  to  incorporate  the  length  of  the  segment,  say  L  miles, 
we  slightly  modify  the  intensity  function  as 

r(t  |  a,/?)  =  Lg  (g)  - 
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Expert  opinion  on  the  track  segment  is  generally  baaed  on  the  outcome  of  engineering/deterministic 
models.  In  this  form,  the  physics  of  the  rail  deterioration  is  incorporated  into  the  model  as  prior 
information.  Thereafter,  the  natural  inclusion  of  observed  defects  into  the  model  provides  further 
possibilities  of  better  predictions,  overcoming  a  limitation  of  engineering/deterministic  models  which 
can  not  be  automatically  calibrated  as  data  become  available.  A  customized  computer  implementation 
of  the  Weibull  process  using  expert  opinion  has  been  developed  for  the  Association  of  American 
Railroads  [see  Campodonico  (1992)]. 

In  order  to  demonstrate  the  evolution  of  the  prediction  process  we  present  some  results  for  a 
railroad  segment  of  length  L  =  105  miles,  which  we  call  Railroad  A.  Based  on  the  outcomes  of  an 
engineering  model,  the  railroad  expert  selects  two  million-gross-ton  (MGT)  intervals,  both  starting  at 
zero.  He/she  then  enters  the  most  likely  number  of  defects  in  each  interval  and  a  subjective  measure  of 
uncertainty  or  variability.  Figure  1  reproduces  a  computer  screen  for  the  input  of  expert  opinion. 

Defect  data  on  Railroad  A  was  collected  starting  in  1986,  by  which  time  the  track  had 
accumulated  600  MGT.  The  annual  traffic  for  that  year  was  45  MGT,  and  the  number  of  observed 
fatigue  defects  was  16.  We  also  obtained  data  on  the  annual  traffic  and  observed  defects  for  the  years 
1987-1990.  In  order  to  illustrate  the  evolution  of  the  prediction  process,  let  us  suppose  that  we  start  at 
the  end  of  year  1985  and  that  the  traffic  (in  MGT)  for  the  next  five  years  (1986  to  1990)  is  known.  In 
1985,  the  number  of  defects  for  the  future  annual  traffic  intervals  are  estimated  based  on  expert 
opinion  alone.  By  the  end  of  1986,  the  first  data  become  available  so  that  we  update  the  predictions 
for  the  following  4  years  (1987  to  1990).  The  updating  procedure  can  be  repeated  by  the  end  of  each 
year  once  the  number  of  defects  observed  during  the  ending  year  is  released.  Figure  2  summarizes  the 
above  exercise  by  showing  the  expected  number  of  defects  predicted  per  annual  MGT  interval.  The 
predictions  for  each  interval  can  then  be  compared  to  the  actual  number  of  observed  defects.  In 
addition  to  the  expected  values,  a  probability  distribution  for  the  number  of  defects  in  any  MGT 
interval  can  also  be  calculated.  Figure  3,  for  example,  reproduces  the  prior  and  posterior  probability 
distributions  of  the  number  of  fatigue  defects  in  the  interval  (818,  885]  MGT.  The  posterior 
distribution  corresponds  to  the  combination  of  the  prior  information  and  the  observations  from  years 
1986  to  1989.  We  observe  that  the  posterior  distribution  is  not  only  shifted  to  the  right,  but  also 
sharper,  i.e.,  the  uncertainty  has  been  reduced. 
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INPUT  EXPERT  OPINION 


Enter  the  following  information:  (I/O  drive:  C) 

•Two  MGT  intervals  (both  starting  from  zero)  within  which  the  number 

of  defects  per  mile  can  be  best  predicted.  _ 

First  interval:  (0.1  600.0011  Second  interval:  (0,1  952.00]] 

•Your  best  guess  about  the  number  of  defects  per  mile 
in  the  FIRST  interval,  ml  =  1  0.6000). 

•A  997.  credibility  interval  around  ml  (  0.6000),  i.e.,  you  are  almost 
sure  that  the  true  value  for  the  number  of  defects  per  mile  in  the  FIRST 
interval  will  lie  between  I  0.2000]  and  |  1 ,0QQQj  defects. 

•Your  best  guess  about  the  number  of  defects  per  mile 
in  the  SECOND  interval,  m2=  |  1.80Q01. 

■A  997.  credibility  interval  around  ml  (  1.8000),  i.e.,  you  are  almost 
«„re  that  the  true  value  for  the  number  of  defects  per  mile  in  the  SECOND 
interval  will  lie  between  I  1.20001  and  1  2.40QQj  defects. 

•An  identification  message  concerning  the  above  input  (optional): 

ITANGENT  TRACK  SEGMENT  FOR  RAILROAD  A  . - - -1 


Figure  1.  Screen  for  the  input  of  expert  opinion. 


Expected  #  of  Defects  per  MGT  Interval  in  the  Segment 


Annual  MGT  Interval  (MGT  Increment) 


□  Prior  E3+ 1  obs.  S  +  2  obs. 

S  +  3  obs.  E3+  4  obs.  ■  Observed  Defects 

Figure  2.  Expected  defects  as  they  evolve  with  additional  data. 
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PROBABILITY 


—  PRIOR  —  PRIOR +4  OB S. (86-89)  x  OBSERVED  DEFECTS 

Figure  3.  Probability  Distribution  for  the  number  of  Defects 
in  the  traffic  interval  (818,  885]  MGT  (corresponding  to  1990). 


5.  FINAL  COMMENTS 

Computer  implementations  of  the  procedures  presented  in  this  article  are  required  in  order  to 
evaluate  the  integrals  involved  in  the  assessment  of  the  quantities  of  interest  given  by  Equations  (1) 
and  (2)  for  the  reliability  assessment  of  a  component,  and  by  Equations  (4)  and  (6)  for  estimating  the 
number  of  counts  or  defects  in  future  time  intervals.  Some  examples  of  general  numerical  techniques 
used  for  the  evaluation  of  integrals  are  the  Gauss- Laguerre  approximations,  the  Tierney- Kadane 
approximations,  and  simulation  techniques  such  as  Monte-Carlo  integration  and,  more  recently,  the 
Gibbs  sampling.  The  rapid  advances  in  computer  technology  as  well  as  in  numerical  methods  promote 
the  choice  of  model  assumptions  which  are  intuitively  reasonable  rather  than  merely  mathematically 
convenient.  The  approach  here  has  been  to  look  at  expert  opinion  as  data  and  to  construct  their 

likelihood. 
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